Papers with LLM-as-a-Judge mechanism
PrefIx: Understand and Adapt to User Preference in Human-Agent Interaction (2026.findings-acl)
Copied to clipboard
| Challenge: | Current benchmarks evaluate task accuracy but overlook how agents interact . Preference-aware agents show 7.6% average UX improvement and 18.5% gain in preference alignment. |
| Approach: | They propose a configurable environment that evaluates both what agents accomplish and how they interact. |
| Outcome: | The proposed model improves performance and improves user experience by 7.6% and 18.5% respectively. |